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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a relational 
function searching device quickly and exactly 
determining the relational function denoting the 
relationship between given input data and output data by 
little computer resources and method therefor. 
SOLUTION: This device is provided with a function 
generation means 3 combining a function element and a 
parameter and generating a relational function 
candidate, a generation evolution means 4 evolving a 
present relational function group to the relational function 
of the next generation by the evolution technique by a 
genetic algorithm, a parameter estimation means 7 
estimating the optimum value of the parameter of each 
relational function evolved by the generation evolution 
means 4 by a linear regression technique or a non-linear regression technique, an evaluation 
means 8 evaluating the fitness for given input/output data for the relational function in which 
the optimum value is estimated by the parameter estimation means 7 and a selection means 
9 preferentially selecting the relational function evaluated that the fitness is high by the 
evaluation means 8. 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] By the technique of a function generation means to generate a related function candidate 
combining a functional element and a parameter, and evolution by the genetic algorithm The generation 
evolution means who evolves the ensemble of a current related function to the ensemble of a next- 
generation related function, A parameter estimation means to presume the optimum value of the 
parameter of each relation function which evolved with said generation evolution means by the linear- 
regression technique or the non-linear regression technique, As opposed to the related function the 
optimum value was presumed to be by said parameter estimation means Related function retrieval 
equipment characterized by having an evaluation means to evaluate the fitness to a given I/O data, and 
a selection means to choose preferentially the related function estimated that fitness is high by said 
evaluation means. 

[Claim 2] Related function retrieval equipment of the publication according to claim 1 characterized by 
having the function simplification means which rewrites the related function generated by said 
generation evolution means in a simple form synonymous in formula. 

[Claim 3] Related function retrieval equipment according to claim 1 characterized by having a 
contradiction function inspection means to inspect the form as a formula of a related function, to sort out 
a related function irrational as a formula, and to except from the object of presumption of a parameter. 
[Claim 4] Said generation evolution means is related function retrieval equipment according to claim 1 
to 3 characterized by evolving a related function by decussation, mutation, and at least one approach of 
evolution out of balance. 

[Claim 5] said parameter estimation means - the approach of linear regression, and Guass-Newton — 
law and Levenberg-Marquart — law and Steepest Descent - law and Quasi-Newton — law and Simplex 
Law and Weighting law and Ridge Regression - law and Full Newton Related function retrieval 
equipment according to claim 1 to 3 characterized by presuming the optimum value of each relation 
function candidate's parameter by either of the law. 

[Claim 6] Down stream processing which generates the population of a related function candidate's 
beginning combining a fiinctional element and a parameter, and the related function candidate of said 
population by the technique of evolution by the genetic algorithm Down stream processing which is 
evolved and generates a next-generation related function candidate's ensemble, and down stream 
processing which presumes the optimum value of each of said evolved relation function candidate's 
parameter by the linear-regression technique or the non-linear regression technique, Down stream 
processing which evaluates the fitness to a given I/O data to the related function candidate by whom 
said optimum value was presumed, Down stream processing which chooses the high related function 
candidate of fitness preferentially among the related function candidates who evaluated said fitness, Said 
selected, related function candidate's ensemble as a new related function candidate's population Down 
stream processing which repeats many processings from evolution by said genetic algorithm to selection 
of the high related function candidate of fitness, The related function retrieval approach characterized by 
having down stream processing which outputs the related function candidate who reached more than 
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predetermined fitness, or the related function candidate who has the highest fitness after generation 
evolution of the count of predetermined as optimal related function. 

[Claim 7] The related function retrieval approach according to claim 6 characterized by having down 
stream processing which rewrites a related function candidate in a simple form synonymous in formula 
after down stream processing which generates a next-generation related function candidate's ensemble 
by evolution by said genetic algorithm. 

[Claim 8] The related function retrieval approach of claim 6 characterized by having down stream 
processing which inspects the form as a formula of a related function, sorts out a related function 
candidate irrational as a formula, and is excepted from the object of presumption of a parameter by 
evolution by said genetic algorithm after down stream processing which generates a next-generation 
related function candidate's ensemble. 

[Claim 9] Down stream processing of evolution by said genetic algorithm is the related function 
retrieval approach according to claim 6 to 8 characterized by evolving a related function candidate by 
decussation, mutation, and at least one approach of an advance out of balance. 
[Claim 10] down stream processing of presumption of said parameter — the approach of linear 
regression, and Guass-Newton - law and Levenberg-Marquart law and Steepest Descent - law and 
Quasi-Newton — law and Simplex Law and Weighting law and Ridge Regression - law and Full 
Newton The related function retrieval approach according to claim 6 to 8 characterized by presuming 
the optimum value of each relation function candidate's parameter by either of the law. 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the related function retrieval equipment which searches 
for the related function (function showing input/output relation) with which are most satisfied of the 
relation of those input data groups and output-data groups autonomously, and its approach, when the 
input data group and the output-data group are given beforehand. 
[0002] 

[Description of the Prior Art] The relation of the input data and the output data which gave input data 
and output data (two or more sets of cases are included) as a sample to the computer by development of 
computer technology in recent years, and were given by computer is learned, and the technique which 
outputs the output data which balance the relation to new input data based on the learned relation is 
developed. A neural network is mentioned as such a technique. 

[0003] With a neural network, the count unit of a multi-input-output is combined in the shape of a nerve 
net by the directivity link with weight, and a network is constituted. Each count unit computes one 
output value to an input value, processing is ****(ed) to other count units through a link with weight for 
it, and the count unit of the last layer outputs final output data. 

[0004] The output value outputted to this neural network's behavior, i.e., a fixed input value, is defined 
by the gestalt of association of that link, the weight of each link, and the function of a count unit. 
[0005] When the sample of input data and output data is given to a neural network as a target of study, a 
neural network outputs the output data which have processed the input data with the weight of initial 
value. Next, a neural network compares these output data with the output data of a learning objective, 
asks for total of that error and the square error of a usual output value and desired value, and he adjusts 
the weight of each link so that this error may become the smallest. Processing of this study is called 
"error reverse ****", and can be processed as a problem of the non-linear regression which makes 
weight of each link a parameter. 

[0006] thus, the neural network who learned can output output data also to new input data in the form 
well approximated to the relation of the I / O data which boiled previously and was given as a learning 
objective. 

[0007] however, although the output data which the above-mentioned neural network approximated the 
relation of the I / O data given as a learning objective, and balanced it to new input data could be 
outputted, the learned input/output relation has not been grasped from the outside (input/output relation 
"is not a positive" about this — "it being said [-like / positive table ] that it is not" again). 
[0008] Since input/output relation was not positive table-like, a neural networks approach was not able 
to evaluate the validity of the input/output relation from a logical viewpoint. That is, in a neural 
network, the input/output relation has taken what kind of form (form of a function), and what the learned 
input/output relation can estimate numerically how many relation of the I / O data of a learning objective 
as was not able to presume whether it would be logically probable. 

[0009] For this reason, when approximation and prediction were actually carried out using a neural 
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network in fields, such as economy, finance, management, marketing, and science, that result 
approximated or predicted could not presume whether it was the right, but had become the hindrance to 
utilization. 

[0010] On the other hand, the statistical approximation-of- function method for searching for the 
input/output relation of input data and output data in positive table is learned to the above-mentioned 
neural network. Generally as this statistical approximation, the linearity multiple regression, the 
nonlinear multiple regression, etc. are known. 

[001 1] A linearity multiple regression is the approach of defining the parameters a, b, and c which suit 
input data and output data most with this linear function as input/output relation supposing a linear 
function like Y=aXl+bX2+c. 

[0012] On the other hand, a nonlinear multiple regression is the approach of extending the above- 
mentioned linearity multiple regression further, and defining Parameters a, --, d as a related function 
supposing a nonlinear function like Y=aXl A 2+bXl+cX2+d. 

[0013] However, since the describing [ above ] statistical approximation-of- function method had the 
form with the fixed function which gives input/output relation, it was not able to satisfy suitable 
input/output relation except the above-mentioned linear function and a nonlinear function. 
[0014] The approach of asking for the related function of a free form from the describing [ above ] 
statistical approximation-of- function method is John Koza of Stanford University. It is advocated by the 
professor. It was what generates the related function which suited the input/output relation which 
predetermined carried out number generation of the related function at random first, and Professor Koza 
evolved from these related functions repeatedly by the approach of evolution by the genetic algorithm, 
and was finally given. 

[0015] The approach of evolution by the above-mentioned genetic algorithm deals with two or more 
related functions which are recognizing current existence first as a ream of a series of components like 
the DNA array of a chromosome, respectively, and makes some elements of those related functions 
exchange mutually (these are called "decussation"), or throws a new element into some elements of a 
related function by the fixed probability, and generates the ensemble of new (this is called "mutation") 
input/output relation. Next, the related function candidate who generated is evaluated, what suited the 
given input/output relation from a related function candidate's ensemble is chosen, and processing of 
evolution, evaluation, and selection is further repeated about the selected, related function candidate's 
ensemble. Thus, what finally satisfies input/output relation is obtained by performing processing of 
repeat evolution, evaluation, and selection. 

[0016] It is called "evolution of time cost" by the approach of evolution by the genetic algorithm to 
generate the ensemble of other input/output relation from the ensemble of one related function by the 
above-mentioned evolution, evaluation, and selection. The input/output relation which was made to 
random by repeating evolution of a generation at the beginning according to the approach of evolution 
by the genetic algorithm changes the form, while what satisfies the given input/output relation more is 
chosen, what does not satisfy input/output relation is screened and the related function with which are 
most satisfied of the input/output relation finally given is generated. 
[0017] 

[Problem(s) to be Solved by the Invention] However, by the approach of the related function retrieval by 
the genetic algorithm by above-mentioned Professor Koza, the convergency to the optimal function 
generation was low, and was not almost able to present a practical application. 
[0018] That is, all of the numeric value of parameters, such as a function (these are hereafter called 
functional element collectively) used as elements, such as four operations, an exponential function, a 
logarithmic function, and a trigonometric function, a multiplier by which these functional elements are 
multiplied, and a constant to apply, were chosen as random, and the function consisted of approaches by 
Professor Koza. For this reason, the countless function existed by difference of a parameter also about 
the form of one fixed function. The convergency to the form of a function where it was suitable for I/O 
conditions under the effect of this parameter was very low. 

[0019] Moreover, in order to make the function which has the genius which satisfies I/O conditions into 
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the candidate of the function of each generation who makes it evolve exist, the number of each 
generation's function had to be made [ many ]. For this reason, the computer to process had to be what 
has the very big capacity and throughput. 
[0020] 

[Means for Solving the Problem] In order to solve the above-mentioned technical problem, the related 
function retrieval equipment concerning this application claim 1 By the technique of a function 
generation means to generate a related function candidate combining a functional element and a 
parameter, and evolution by the genetic algorithm The generation evolution means who evolves the 
ensemble of a current related function to the ensemble of a next-generation related function, A 
parameter estimation means to presume the optimum value of the parameter of each relation function 
which evolved with said generation evolution means by the linear-regression technique or the non-linear 
regression technique, As opposed to the related function the optimum value was presumed to be by said 
parameter estimation means It is characterized by having an evaluation means to evaluate the fitness to a 
given I/O data, and a selection means to choose preferentially the related function estimated that fitness 
is high by said evaluation means. 

[0021] The related function retrieval equipment concerning this application claim 2 is characterized by 
having the function simplification means which rewrites the related function generated by said 
generation evolution means in a simple form synonymous in formula in the equipment of claim 1 . 
[0022] The related function retrieval equipment concerning this application claim 3 is characterized by 
having a contradiction function inspection means to inspect the form as a formula of a related function, 
to sort out a related function irrational as a formula, and to except from the object of presumption of a 
parameter in the equipment of claim 1 . 

[0023] Said generation evolution means is characterized by the related function retrieval equipment 
concerning this application claim 4 evolving a related function in claim 1 thru/or one related function 
retrieval equipment of 3 by decussation, mutation, and at least one approach of evolution out of balance. 
[0024] the related function retrieval equipment concerning this application claim 5 — claim 1 thru/or one 
related function retrieval equipment of 3 ~ setting — said parameter estimation means — the approach of 
linear regression, and Guass-Newton - law and Levenberg-Marquart -- law and Steepest Descent - law 
and Quasi-Newton -- law and Simplex Law and Weighting law and Ridge Regression - law and Full 
Newton It is characterized by presuming the optimum value of each relation function candidate's 
parameter by either of the law. 

[0025] The related function retrieval approach concerning this application claim 6 down stream 
processing which generates the population of a related function candidate's beginning combining a 
functional element and a parameter, and the related function candidate of said population by the 
technique of evolution by the genetic algorithm Down stream processing which is evolved and generates 
a next-generation related function candidate's ensemble, and down stream processing which presumes 
the optimum value of each of said evolved relation function candidate's parameter by the linear- 
regression technique or the non-linear regression technique, Down stream processing which evaluates 
the fitness to a given I/O data to the related function candidate by whom said optimum value was 
presumed, Down stream processing which chooses the high related function candidate of fitness 
preferentially among the related function candidates who evaluated said fitness, Said selected, related 
function candidate's ensemble as a new related function candidate's population Down stream processing 
which repeats many processings from evolution by said genetic algorithm to selection of the high related 
function candidate of fitness, It is characterized by having down stream processing which outputs the 
related function candidate who reached more than predetermined fitness, or the related function 
candidate who has the highest fitness after generation evolution of the count of predetermined as optimal 
related function. 

[0026] The related function retrieval approach concerning this application claim 7 is characterized by 
having down stream processing which rewrites a related function candidate in a simple form 
synonymous in formula after down stream processing which generates a next-generation related function 
candidate's ensemble by evolution by said genetic algorithm in the approach of claim 6. 
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[0027] The related function retrieval approach concerning this application claim 8 is characterized by 
having down stream processing which inspects the form as a formula of a related function, sorts out a 
related function candidate irrational as a formula, and is excepted from the object of presumption of a 
parameter by evolution by said genetic algorithm after down stream processing which generates a next- 
generation related function candidate's ensemble in the approach of claim 6. 

[0028] The related function retrieval approach concerning this application claim 9 is characterized by 
down stream processing of evolution by said genetic algorithm evolving a related function candidate by 
decussation, mutation, and at least one approach of an advance out of balance in the approach of claim 6 
thru/or either of 8. 

[0029] the related function retrieval approach concerning this application claim 10 ~ the approach of 
claim 6 thru/or either of 8 — setting — down stream processing of presumption of said parameter — the 
approach of linear regression, and Guass-Newton — law and Levenberg-Marquart — law and Steepest 
Descent -- law and Quasi-Newton -- law and Simplex Law and Weighting law and Ridge Regression -- 
law and Full Newton It is characterized by presuming the optimum value of each relation function 
candidate's parameter by either of the law. 
[0030] 

[Embodiment of the Invention] One gestalt of operation of this invention is explained using an attached 
drawing below. Drawing 1 shows the example of 1 configuration and the flow of processing of the 
related function retrieval equipment by this invention. The related function retrieval equipment 1 of this 
operation gestalt is used combining it with the external information processor 2. Related function 
retrieval equipment 1 consists of the function generation means 3, the generation evolution means 4, the 
function simplification means 5, the contradiction function inspection means 6, the parameter estimation 
means 7, an evaluation means 8, and a selection means 9. On die other hand, an information processor 2 
consists of the input means 10, a processor 1 1, an output means 12, and a storage means 13. Here, the 
related function retrieval equipment by this invention is used as the independent equipment combined 
with an external information processor like the above-mentioned operation gestalt, and also it can also 
be considered as the configuration which equipped itself with the input means, the output means, the 
storage means, etc. 

[0031] The related function retrieval equipment of this invention is also realizable by starting still more 
preferably the software which specified actuation of equipment in the information processor of a general 
configuration of having had the processor, the input means, the storage means, and the output means. 
[0032] Next, processing of the related function retrieval equipment of this operation gestalt is explained 
below. With the related function retrieval equipment 1 of the above-mentioned operation gestalt, input 
data and output data (this is collectively called I/O data) to ask for the relation between an input and an 
output first are stored in the I/O data file 14 of the storage means 13 with the input means 10 of an 
information processor 2. Allocation of the conditions of evolution by the genetic algorithm at the time of 
asking for a related function (function showing the relation of a I / O data), i.e., the number of the 
candidates of a related function who perform evolution, (this is called ensemble size), the crossing 
probability (this is called rate of decussation), a mutation rate, the number (this is called generation 
number) which repeats evolution, the allowed value of fitness, and the probability at the time of 
selection etc. inputs into coincidence with an input means 10. 

[0033] By the input of the conditions of evolution of the above-mentioned genetic algorithm, the 
function generation means 3 generates many candidates of a related function based on these conditions. 
The these-generated related function candidate forms the population of the related function candidate for 
evolution. 

[0034] Here, the approach of generation of the related function which serves as a candidate is explained. 
The ftinction generation means 3 takes out the functional element of a predetermined individual from the 
functional-element file 15 of the storage means 13 of an information processor 2, and arranges these 
functional elements, a variable, and a parameter at random. The above-mentioned functional element 
also contains operators, such as ** (+) besides functions, such as BEKI ** ( A n), sin, cos, log and exp, 
and --, a decrease (-), ** (*), and ** (/). The above-mentioned variable is a part which substitutes input 
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data, and only the degree of input data exists. Finally, a multiplier, a constant, etc. substitute a concrete 
numeric value and the above-mentioned parameter expresses them with notations, such as a, b, c, and — , 
in the phase of function generation. 

[0035] For example, when a functional element, a variable, and a parameter array are set to ((XI) A ), (a), 
(-), (b), (*) (XI), (*) (X2), (+), (c), (*) (X2), ( A ), (d), (-), and (e), This array means the following relation 
function candidate Y=Xl A a-bXl X2+cX2 A d-e. ( ) Inside serves as this related function candidates 
component (a function, a variable, and a parameter are included). 

[0036] Similarly, when the array of a functional element, a variable, and a parameter becomes ((XI) +), 
(b), and (*) (sin) ((c), (*), and (X2)), this is following related function candidate Y=Xl+bsin (cX2). 
It means. 

[0037] Thus, all related function candidates are expressed by the linear array of components, such as a 
functional element, a variable, and a parameter. Therefore, the function generation means 3 can generate 
the candidate of a related function by arranging to linearity, combining a functional element, a variable, 
and a parameter at random. 

[0038] By the above-mentioned approach, the function generation means 3 generates a related function 
candidate until it reaches the ensemble size beforehand specified with the input means 10, and it stores 
this in the related function file 16 as a related function candidate's population. 
[0039] Next, the generation evolution means 4 takes out the population of the candidate of a related 
function from the related function file 16, and evolves this by the technique of a genetic algorithm. 
There are decussation, mutation, and many approaches of evolution out of balance in evolution by the 
technique of this genetic algorithm, the related function retrieval equipment 1 of this invention - the 
above - evolution by the genetic algorithm may be performed by which approach. 
[0040] The genetic manipulation which a chromosome carries out pair [ every ] coupling to the above 
"decussation" in heredity of a living thing, exchanges a part of gene for it, and obtains the chromosome 
of a new gene sequence is imitated. That is, deal with a related function candidate as a series of arrays 
which consist of components, such as a functional element, a variable, and a parameter, make those 
related function candidates face a pair every, a part of functional element, variable, and parameter are 
made to exchange, and the candidate of the related function of a new pair is obtained. A mimetic 
diagram explains this in more detail using the related function candidate who did [ above-mentioned ] 
instantiation. 

[0041] Drawing 2 shows the situation of decussation of two related function candidates. It is Yl =Xl A a- 
bXl X2+cX2 A d-eY2 =Xl+bsin (cX2) about the related function candidate before now and decussation. 
It carries out. These related function candidates can express to a tree structure as shown in drawing 2 . 
The articulating point (it is called a node) of a tree shows each functional element. On the other hand, 
the end leaf part (it is called a leaf) of a tree shows the parameter or the variable. 
[0042] Decussation is performed by the node of the arbitration of a tree structure, and the node and leaf 
below that node cross as one lump in this case. For example, it is Yl as shown in drawing 2 . Node 17 
andY2 It is Yl when decussation is performed by the node 18. 17 or less-node cX2 A d Y2 It is mutually 
exchanged as 1 lump in sin below a node (cX2), respectively. Consequently, Yl Y2 It evolves into 
following Yl ' and following Y2', respectively. 

Yl f =Xl A a-bXl X2+sin(cX2)-eY2 *=Xl+bcX2 A d, thus every two related function candidates of all of 
the population are put together, it crosses and a new related function candidate's ensemble is generated 
by this. The ensemble of this generated related function candidate calls it "a next-generation ensemble" 
to the population. This next-generation ensemble's related function candidate is stored in the related 
function file 16. 

[0043] To "decussation" exchanging a related function candidate's component mutually, "mutation" 
changes each related function candidate's component, and generates a new related function candidate. 
[0044] That is, the "mutation" in this equipment is changed by the fixed probability to all the related 
target function candidate's components. Change is random and transposes each functional element, a 
variable, and a parameter to an unrelated functional element, a variable, and a parameter. The next- 
generation ensemble who consists of a new related function candidate is generated by this. The next- 
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generation ensemble of the related function candidate by this mutation is also stored in the related 
function file 16. 

[0045] Next, the approach of "evolution out of balance" is explained. "Evolution out of balance" 
generates two or more children's (two [ for example, ]) related function candidate from one related 
function candidate, and a child [ be / it / just like that of parents ] and the child from whom some parents' 
elements changed are made to be intermingled for these children's related function candidate. Thus, by 
repeating the generation evolution which the child of different nature from parents mixes, the various 
individuals to an individual which is completely different from an individual [ be / it / just like that of 
the original parents ] are generated, and when the fitness in it chooses a high thing, it can converge on 
the optimal related fixnction. 

[0046] Drawing 3 shows notionally the situation of the above-mentioned evolution out of balance. In 
drawing 3 , one parents' related function candidate generates two children's related function candidate. 
Each parents' related function candidate is leading in case a child is generated. A chain and lagging The 
template for copying a child called a chain is also as two. 

[0047] leading In case a chain 19 (a downward arrow head shows drawing 3 ) generates a child, it 
carries out similar succession of parents' characteristic, it makes this a template, and is the other party's 
lagging. A chain 20 (a upward arrow head shows drawing) is reproduced, and a child is generated. In 
drawing 3 , a broken line shows the chain of the side reproduced. On the other hand, it is lagging. In 
case a chain 20 generates a child, it makes Mutation e mix in parents' characteristic (here a related 
function candidate's component) by the fixed probability. The form containing this mutation e is used as 
a template, and it is the other party's leading. A chain 19 is reproduced and the child from whom parents 
and a characteristic differed is generated. 

[0048] By repeating the above-mentioned evolution out of balance, the various individuals which 
consist of the individual which carried out similar succession of the first parents' characteristic, an 
individual which mutation accumulates and is extremely different from the first parents, and an 
individual of the middle characteristic are generable. Drawing 3 shows the case where three generations 
evolve, and two mutation e is lagging by one-generation evolution. Three-kind four individuals are 
generated by the 3rd generation from what does not contain Mutation e at all to whether four mutation e 
is included and a thing which becomes and is different noting that it mixes in a chain 20. 
[0049] The approach of evolution of each genetic algorithm of the above "decussation", "mutation", and 
"evolution out of balance" may be used independently, and can also be combined and used. For 
example, after carrying out mutation or carrying out out-of-balance evolution by the probability for it to 
be fixed after crossing, it can carry out producing mutation in a fixed probability to the whole related 
function candidate etc. 

[0050] Next, it returns to drawing 1 about processing after it of the related function candidate who 
evolved with the generation evolution means 4, and explains below. 

[0051] The function simplification means 5 rewrites these in the function of the simple form of 
homonymy in formula, taking out the related function candidate of the above-mentioned next generation 
from the related function file 16, and referring to the simplification Ruhr file 21, after a related function 
candidate's next-generation ensemble is generated from a related function candidate's population. 
[0052] For the generation evolution means 4, since decussation etc. completely makes the component of 
a related function random, this is X(a+b+c) 1 in a part of related function. abcXl A part [ like ] may 
exist (it is here and, for a, b, and c, a parameter and XI are a variable). Since these fUnction parts can be 
rewritten in a simple form, the function simplification means 5 is X(a+b+c) 1. dXl (new parameter with 
which d consists of d=a+b+c), and abcXl It rewrites to dXl (new parameter with which d consists of 
d=axbxc). The parameter which should be dealt with by this can decrease and many processings of 
presumption of the parameter described henceforth, evaluation, selection, etc. can be performed more 
easily. Much simplification Ruhr of the form after being simplified with the decision conditions which 
can simplify a formula is stored in the simplification Ruhr file 21. 

[0053] Thus, when it judges and corresponds with reference to the simplification Ruhr of the 
simplification Ruhr file 21 about each relation function candidate, the function simplification means 5 is 
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stored in the related function file 16 after it rewrites a related function candidate. 
[0054] Next, the contradiction function inspection means 6 sorts out a related function irrational as a 
formula, taking out the related function candidate rewritten by the simple form from the related function 
file 16, and referring to the inspection Ruhr file 22 with the function simplification means 5, and 
presumption of the parameter described later, evaluation, etc. make it the object of processing. 
[0055] A thing irrational as a formula is one half of log (negative number) and (negative numbers). ** 
etc. is needed. The contradiction function inspection means 6 eliminates a related function candidate 
irrational as a formula, builds the ensemble who consists only of a rational related function candidate, 
and stores him in the related function file 16. 

[0056] Next, the ensemble of the related function candidate by whom the parameter estimation means 7 
was sorted out and stored with the above-mentioned contradiction function inspection means 6 is taken 
out from the related function file 16, and the optimal numeric value of each relation function candidate's 
parameter is presumed concretely. 

[0057] Now and input data xl, --, xn Output data yl, yn If the related function which shows relation 
is set to f, it will depend on vector theta= [ whether the related function f approximates input/output 
relation ] (theta 1, — , thetak) of the combination of the numeric value of a parameter, i.e., a parameter. 
[0058] In this case, retrieval of the optimal related function is transposed to the retrieval in parameter 
space. Retrieval of this optimal parameter is performed so that total of a square error with the related 
flinction f (xi, theta) of the vector theta of output data yi (i= 1, — , n) and a predetermined parameter may 
be made into min. Here, total of the square error of output data yi (i= 1, --, n) and the related function f 
(xi, theta) can be expressed in writing like a bottom type. 

D 

S ~2 (0) =E (y i-f (z i, 0) ) ~2 

Very small modification is added in the direction in which the above S A 2 (theta) decreases, and it is 
made to specifically result in the vector theta of a parameter in it at the optimal related function in the 
vector of a successive optimal parameter, i.e., the form of the function. 

[0059] Gauss-Newton well-known as presumption of the above-mentioned parameter, i.e., the approach 
of retrieval of the parameter vector in parameter space, — law — The Levenberg-Marquart method and 
SteepestDescent Law, The Quasi-Newton method and Simplex Law and Weighting Law, The Ridge 
Regression method, Dennis and Gay and Welsch Full Newton boiled and depended Either of the law It 
can use (refer to Sen Srivastava, Regression Analysis Theory by Springer Verlag work, and Methods 
and Applications). 

[0060] For example, according to the desirable Steepest Descent method, the partial differential of the 
function S is carried out with each parameter, and a parameter is changed in the gradient direction which 
is the maximum dive direction. Namely, theta (r+1) =theta (r) -alpha (r) As delta (r) shows, theta is 
changed serially. 

[0061] Here, it is theta (r). theta and delta (r) for which the r-th time was asked theta (r) The maximum 
dive direction which can be set, theta 1 [ i.e., ] of S A 2 (theta), — , and thetak The maximum of the partial 
differential which can be set, and alpha (r) theta (r) The width of face of change in the maximum dive 
direction is shown. 

[0062] With the Steepest Descent method, it is alpha (r). By considering as a suitable value, by repeating 
change of theta, S A 2 (theta) comes to take the minimum value, presumes the parameter vector theta at 
this time (= theta 1, --, thetak) to be an optimal parameter, and determines the concrete form of a related 
function. 

[0063] By the above-mentioned approach, the parameter estimation means 7 presumes the optimal 
parameter of the candidate of each relation function, and stores it in the related function file 16. 
[0064] Next, the evaluation means 8 computes each relation function candidate's fitness with reference 
to the I/O data file 14 about the candidate of each relation function concretely specified by the parameter 
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estimation means 7. In this case, fitness can also be considered as the total S A 2 (theta) of the square error 
computed previously, and can give a gravity to the group of a I / O data, and can also give high fitness 
by the related function candidate who adapts himself to the group of an important I/O data. The related 
function candidate who was able to give fitness with the evaluation means 8 is stored in the related 
function file 16. 

[0065] Next, the selection means 9 chooses a related function candidate from current related function 
candidates focusing on what has high fitness. 

[0066] There are some which combined the roulette method, elite Conservation Act, and these as the 
selection approach by the above-mentioned selection means 9. 

[0067] The roulette method assigns each candidate the probability proportional to fitness, and chooses 
the high candidate of fitness by the high probability. According to this approach, possibility that what 
has the low present fitness may be chosen and that selected thing will evolve into the optimal thing by 
evolution in the future can be collateralized. 

[0068] On the other hand, elite Conservation Act chooses a fixed number of candidates sequentially 
from the high candidate of fitness. Although its current fitness is low while what has current fitness high 
[ this approach ] has the advantage surely chosen, what has good genius also has the fault screened. 
[0069] The selection by the selection means 9 of this operation gestalt combines the advantage of the 
describing [ above ] roulette method and elite Conservation Act. That is, a fixed number of candidates 
are chosen as the high order of fitness by elite Conservation Act, and it chooses by the roulette method 
about what remains. A candidate with high fitness is surely chosen by this, and even if the present 
fitness is low, it can leave possibility that the candidate from whom fitness will become high will also be 
chosen by the fixed probability, by evolution. 

[0070] The candidate of the related function chosen by the selection means 9 is stored in the related 
function file 16. The related function candidate with very high fitness which fitness became less than the 
predetermined reference value at this time is outputted as an adaptation solution in the form where the 
concrete numeric value was substituted for the parameter. When such an adaptation solution is not 
found, the selected, related function candidate is stored in the related function file 16 in the form 
equipped with the parameter with a notation. In this case, in the next generation evolution, the 
generation evolution by the genetic algorithm is presented with the ensemble of the related function 
candidate chosen in the former generation as the new population. 

[0071] A series of processings of evolution by the above-mentioned genetic algorithm, inspection of the 
simplification contradiction function of a function, presumption of a parameter, evaluation, and selection 
are called evolution of the time cost by the genetic algorithm. By repeating the generation evolution by 
this genetic algorithm, related function retrieval equipment 1 can change a related function candidate in 
the direction with which are satisfied of input/output relation gradually, and, finally can obtain the 
related function of the optimal form. 

[0072] In addition, each of above-mentioned function simplification and contradiction function 

inspection is for making presumption of a parameter easy, and can be omitted if needed. 

[0073] Below, the effectiveness of the related function retrieval equipment of this invention in the 

comparison with the conventional related function retrieval equipment by Professor Koza is explained. 

[0074] Drawing 4 compares and shows progress of the retrieval to the optimum solution of the related 

function retrieval equipment by this invention, and the related function retrieval equipment by Professor 

Koza. 

[0075] Although the fitness of the related function candidate by Professor Koza's related function 
retrieval equipment is in the gradient which increases as a whole as shown in drawing 4 , the fitness after 
each ****** cost is fluctuated violently. On the other hand, it can be increased for every ****** cost by 
the fitness of the related function candidate of the related function retrieval equipment by this invention, 
and it can reach the optimum solution of a target slack relation function almost linearly. 
[0076] Therefore, also in the count of a repeat of generation evolution, the related function retrieval 
equipment by this invention can reach the same target by the sharply small count compared with the 
equipment by Professor Koza. 
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[0077] That such a phenomenon arises has a cause in generating in the form where the figure concrete 
into a multiplier or a constant part was substituted for generating a related function candidate with 
Professor Koza's equipment. Thus, the convergency which decision of a thing which the cause of the 
lowness of fitness depends on numeric values, such as what is depended on the form of a function, and a 
multiplier, with the related function of the form where the concrete figure was substituted for the 
multiplier or the constant cannot be performed, but tends toward a target was bad, and retrieval of a 
related function was almost impossible in the throughput of the usual computer. 
[0078] On the other hand, with the related function retrieval equipment by this invention, the form and 
parameter of a function are separated and the numeric value of the optimal parameter is calculated in the 
form of each relation function focusing on evolution of the form of a related function. For this reason, 
the candidate of a related function can approach the form of the quickly optimal related function by 
evolution, and can determine a related function in the form where the concrete numeric value was finally 
substituted for the parameter. The computer which thereby actually has a usual capacity and a usual 
throughput can also search for a related function in the rational range. 
[0079] 

[Effect of the Invention] The related function retrieval equipment by this invention constitutes the 
candidate showing the input/output relation of the given I/O data of a related function with a functional 
element, a variable, and a parameter notation, evolves the candidate of these related functions by 
decussation, mutation, evolution out of balance, etc., and presumes a parameter by technique, such as 
non-linear regression, after an appropriate time so that clearly from the above explanation. Evaluation of 
a related function candidate is performed to the related function candidate who presumed the parameter, 
and fitness leaves a next-generation candidate the candidate of a high related function as a function 
(what expressed the parameter with the notation) of the form. The related function retrieval equipment 
which searches for quickly the input/output relation of the given I/O data in the form of a positive 
table-function with the usual throughput and the computer of capacity by this, and its approach are 
realizable. 
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8 

( (c) (*) (X2 ) ) taoftiB*. cntiTie© 

Y=X1 +b s i n (c X2 ) 

[00 3 7] c©J:'5K:-r'<T<0BBffBBft«*ltt. BB» 
giS i: S8C i: ' * 5 * - * *©*jaiBI6©«UBe5»J K J: o 

[0 0 3 8] ±j£*£tc4»K Bttk£j£#3t3tt. ^46 

A*#ai o»c«koTt§^Lfc»a-9--rxtcii-rs$T' 

LTBH«BBft7r-f;H 6fcttffrT5. 

;n 6*^H«B»o«ffiosia*iRt)fflu eft* 
afEMT^i/druXAo^rSJckoTiift^^So coil 
e»r;l/=fUXAO#j*CJ:«Jlfl:ctts £X, £806 

XAtC <fc * Jtffr&fro T fe «fc 
[0 0 4 0] ±12 r^gxj fcf4, SHfcoMeicfc^TSft 
ft<W-»foA >y XU >XU Se^©— «*2SSftL 

[0 0 4 1 ] 0 2 f4, "OflDSI^BBSSC^M O^XWaiT- 

Yl =X1 "a -bXl X2 + c X2 "d -e 

Y2 =X1 +bsin (c X2 ) 

fcTS. cn60B8«Hft«IM«4» B2fca?TJ:5*V 

©*!6g|5» (4, — 

[0 0 4 2] 3^Xt4, yy-UBBOffilKOy-H^ff* 

5KY1 ©y-h* 1 7 fcY2 <D/— F 1 8T^Xtffft> 
tl5t. Yl <D/-F 1 7«T©c X2 "d f: Y2 ©7 
- KWTO sin (cX2) tfZtlZtl— 0 b 
T5l/Hc3Sgi$nSo C©*SS. Yl i:Y 2(4^+1^ 
ft, TI2<DY1 ' i:Y2' fc«c3i<frSo 
Yl' =X1 'a -bXl X2+s i n (cX2)-e 
Y2 ' =X1 +b c X2 "d 



9 

smfflKflLT "3fc1Btt*H" i:^ 

;H 6lcjgSfi£ft£o 
[0 0 4 3] r£XJ tfB*H»0Sfll©«Mffl8l6*5^ 

[0044] -r&*>-s* *sa»c^tts r^jtsaaj 

gin; *»cil*8r*s. cntCcfcoT. 

[0 0 4 51 90= r^fesftj ©JMfeteo^TKflB-r 
r^KgaBfUbj — o©HtsMa«ffi*^«a© 20 

•5tc. il4:J|ft*«lloW«A'r*1tt«31ft:*li08 

[0046] ®3it±^®mmt<Di^*wt&mc7i< 

MOHJMftlRttli* *PRK: leading JBi: la 

gging jRfcv^^a^— "f SfcftOt>*S*— ofeo 

[0 0 4 7] leading » I 9 (0 3 £*5VTTIr]£©9c 

<9I8*U <m*r>aSkUTffi^01aggiiig «2 

T'^-To -73, lagging §H2 0«. ^*flfejW*«ECil 40 

jg£0£SfCLT*§^73©leading ill 9*1gKU & 
[0 0 4 8] ±Mtt&ffim\t1tm <D&?£tlC£-DX, 

itfbT' 2 fflO^^S e flagging §12 0 ICilA^ % t 50 
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LT, 3lftttBK:M:a«!£Ile*£<*Sfc<^fc©*» 
[0 0 4 9] ±12 T£XJ rsfcJSHBlj i: R:^tBl 

ftj ©*aew7;i/ XAODit{k<D75a«*a!Tfflv^ 
&x*fro ©&w*t?£«5«»s 

[0050] mcmm<t^&4K&^rm<tvrcwm 
[0051] BB»*w{b#a5«. K^Kia^tfoe* 

ne>*^W£P«©«WfcfS©B£o=*£&*£° 

[0 0 5 2] cnti, ffittjt{b#&4«. K^iaia©« 
SWCfcfcAtf (a + b + c) XI «abc XI <D<fc?& 

xi o cn6©wrawit*M4*ct 

tm^CttfffSOf, BB«#*Mb#& 5 tt, (a 
+ b + c)Xl^dXl (dC±d = a + b + cfr£3:-5 
fc&fcfc:/^* — $0 , abcXl^rdXl (d(*d = 

SfBimtcff oc^fs. *Wfb;V— -»i/7rW;U2 i 
ictt. «5£*JH»Mb"i?S *WK»ffi:*Wft bfc*o» 

[0 0 5 3] CO*3»cbTHa*M{b¥a5«, 
0&B»^«K^T*W{b;i/-;i>:77-Oi>2 l ©igfcGfb 

5. 

[0 0 5 4] 5MC, ^M»ftSfS6ti, S8^M 

[0 0 5 5] SSt^tbT^S^feWtti. fefc?L(flo 
g (ftoft) . (most) ©1/2 *, ^cOck 5 

[0 0 5 6] JWc/^^-jrlttfaTtflPFftiPl 



(7) 
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? * - * <Dmm*&mzm&$i\c m^-r 

5. 

[0 0 5 7] 3\ AtiT-Zxl . -. xn tffi^lf- 
*yl . -. yn QHft&iVrHttNft* f fc-TSt. 

= (91 . 6k ) tc«k5 0 * 



12 



* [0 0 5 8] corns. mm%M&mn<Dmm&. 

titfj-r-*yi (i = l. -. n) £ 

mfe<o>^*-2<o^i?v>\'Qvmvkw&.f Cxi, 
e) £0>-mmm<DmQ*m'Nc-?z<ii?\cf : t5 o cc 

■P. ta^-r-^y i (1-1.-. n) i:M«f 
(x i. e) 0=XWK)KniL T5£<Q<fc?fc#£« 



S "2 



(©) =2 
1 .1 



(y i - f (x 1, <8» ) 



g&ma^ ±bs "2 (e) «w^-r«3SrAK:^<?^ 
7^-Zto^hMc. ■t&ttZtoffilS.to&icisifz 
[0059] ±E/<^^-*o«Be, *a*>%/<5*- 

^$n<OGauss-Newton&, Levenberg-Marquarti£* Steep 
estDescent ft^ Quasi-Newtoni£. Simplex Weight i 
ng Ridge Regression?^ Dennis, Cay and Welsch 20 
&C<};&Full Newton feto^-ftlfr&m^Z C ttfXZ 5 
(Sen Srivastava, Springer VerlagHlC £5 Regress ion 
Analysis Theory, Methods and Applications #88) o 
[0 0 6 0] fctpLlf, W£LV>Steepest DescentSjtC 

KT*|pJ-efe5gradient^f($JtC/<^^— $%m£t&<, 

9(r+l) =G(r) -a(r) A (r) 

[006 1] CCT% 9(r) tt r m glC^fe fc6. A 30 
(r) t±e(r) Kl*tt*»ll»T2fftK f#fc>^ S "2 

(e) £D9i , -. ek fctsv&mmtttomxm. a 

(r) «9(r) tomi&MTJ5fa^tomit<Dm*7jkVT^ 
[0 0 6 2] Steepest Descent&T'Wu a (r) £rigi53: 

iinctcj:^ etowt^mom-rctic^o s 

"2 (0) «*/hM*i:5<i;?tc%0. c©i:£©/^ 
r-4/9 (=01, 0k ) ZSM'^* — 

[0 0 6 3] ^7^-^fS7(i, llc^ttCio 40 

x&mmm&tomffitowm/^t-zzmjZL, mmm 

[0 0 6 4] ^»CfFffi#S8«, /<5^-*«S¥a7 
K. «fc o T^tttfHC^S S ft fc*H«M»©«*iK:-31, ^ 

fc-S&^<Z>&faS "2 (9) fc-T«Ci:t»T#SU 

K.-5dtfeT-§5 0 fHffi#S8K:J:oTaU£«*-5*.S 50 



ft/cgg^ia^attK«ig®t7 7"i';i/ 1 6Kte*rt£ft 

[0 0 6 5] 9 tt, afiEOBB«H»«Bf© 

[0 0 6 6] ±fBM«¥f£9U:£5ji«;£S£:LTfi;l/ 
-by h££xU-hfig#ffifccfte>*ffi^*H±/c:fc 

[0 0 6 7] ;1>-L^ r-j£fct, mfo&fcttMVTzVm* 

zmsicmoMT. mttrntoM^m^^mmr-m^ 
i&mti i m->t><D$>M®.zti2> ££&&*). ztommzn 

[0 0 6 8] cniC*fLTxU-h(S#S«, 

s. cto^mt, m&&fc&tf&^i>tote&-fw$izti 

©t±rtett£ft5fe5fe*rL.Tt^3 0 
[0 0 6 9] *^ss^^©a#?#ia9 lassKn ± 

-1/7 hSt i^Tl^tSfeCOT'feSo CftKitK 

a*sa***i/^««tf<& , <*aiR*ft» s^, sgffig^fgtf 
*©si*-e»R«ft*Br(iiit*»-rc t^t?t5o 

[0 0 7 0] »9?#a9KJ:-3TaW«ftfcB8«BBft<0 

mism&ffifetomwm&Lto t & o fcsa&Taj&fctf*^ 

^•?a§"&8¥£LTtij;rj2ft;5c <r<DJ:?:&&"£fB#jl.o 
*»6*^^»&tt, jB«?SftfcB8«M»IR««E-9»!: J: * 

ft*. C©if£- S ^©IftfWitfbUtt^ iJ1Sf^T'SS?Sft 

[0071] ±eae«7 , ;u=f'jXAK:j:*aMt. 



(8) 
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CO 0 7 3] UTfc, Koza^gtCtSSe^Sa^KiaS 
CO 0 7 4] 0 4tt, *8Htc£«HftHft£@£SH& 
C 0 0 7 5 ] 0 4 K jjVf <£ 3 fC KozaStgOM^KScS 

HttHSM&ffaaftAtt* IftfttifterfcKitftibBlBfc 
CO 0 7 6] LfctfoTttfdffc©*»>jgLlHl»»Cfc^ 

CO 0 7 7] COi^ftafeb'SUSCti, KozafStlt© 
c<OJ:3k:«« J f , «»CIM*«*8F* : *«Xbfc 

CO 0 7 8] CtUCftbT, #fS!l3K<fc£IItH£8 
TH«BBftS»5Er*cfc;fl<T?**o ctiKif), JIB? 40 

eatress t wmtittmf sttffwc j: o r «, 

CO 0 7 9] 



a a* BB»*at>-r HHSHgostt* raas^ t ga t 
T«i^-r5„ HftniM&iioffPfiftt* 

LfcH«H*««Hc»LTfT«.\ *Slfc#*^HI«H* 
Lfcf><£>) kbT3WS«0«*l»c»bT«><. CtllCJ: 

*J?< ***H«B!l«lSSR«IIRtf ^o^a^sisi-rs 

C0ffi©«!*«:SiW] 

C0 1 } *&wic&%Mmmmzmmm<D-Mi£mt* 

C0 2] r^j «D«i^€r«fcg:6*>t£:^bfe0o 

C0 4] *«W(CJ:«B(l«n«dSI9ia&B2:Kozaft«lcJ: 

2 Ifffl^aa^B 

3 B8&£fi£¥I8 

4 mtmit^m 

5 &aia#»e{b¥© 

6 ^•&a§asc»aE#® 

7 

8 fP«¥© 

9 3H«#& 

i o 

1 1 mmmw 

1 2 ma*® 

1 3 te«#fia 

1 4 

l 5 B8»S*7r-r;I/ 

1 6 [MBWJ7 7'f/b 
17 y-K 

is y-F 

19 1 ead i ng$ 

2 0 1 a g g i n gift 

2 i mmtJi-^yr^fv 

2 2 
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